Novelty Detection from Evolving Complex Data Streams with Time Windows
نویسندگان
چکیده
Novelty detection in data stream mining denotes the identification of new or unknown situations in a stream of data elements flowing continuously in at rapid rate. This work is a first attempt of investigating the anomaly detection task in the (multi-)relational data mining. By defining a data block as the collection of complex data which periodically flow in the stream, a relational pattern base is incrementally maintained each time a new data block flows in. For each pattern, the time consecutive support values collected over the data blocks of a time window are clustered, clusters are then used to identify the novelty patterns which describe a change in the evolving pattern base. An application to the problem of detecting novelties in an Internet packet stream is discussed.
منابع مشابه
An adaptive algorithm for anomaly and novelty detection in evolving data streams
In the era of big data, considerable research focus is being put on designing efficient algorithms capable of learning and extracting high-level knowledge from ubiquitous data streams in an online fashion. While, most existing algorithms assume that data samples are drown from a stationary distribution, several complex environments deal with data streams that are subject to change over time. In...
متن کاملMining Frequent Patterns in Uncertain and Relational Data Streams using the Landmark Windows
Todays, in many modern applications, we search for frequent and repeating patterns in the analyzed data sets. In this search, we look for patterns that frequently appear in data set and mark them as frequent patterns to enable users to make decisions based on these discoveries. Most algorithms presented in the context of data stream mining and frequent pattern detection, work either on uncertai...
متن کاملAn approach to automatic real-time novelty detection, object identification, and tracking in video streams based on recursive density estimation and evolving Takagi-Sugeno fuzzy systems
Recently, surveillance, security, patrol, search, and rescue applications increasingly require algorithms and methods that can work automatically in real time. This paper reports a new real-time approach based on three novel techniques for automatic detection, object identification, and tracking in video streams, respectively. The novelty detection and object identification are based on the new...
متن کاملA Relational Approach to Novelty Detection in Data Streams
A data stream is a sequence of time-stamped data elements which arrive on-line, at consecutive time points. In this work we propose a multi-relational approach to mine complex data streams in order to identify novelty patterns which target new or unknown situations in the stream. Multi-relational data mining is motivated by the existence of several real-world data stream applications where data...
متن کاملLearning from Data Streams: Synopsis and Change Detection
The emergence of real temporal applications under non-stationary scenarios has drastically altered the ability to generate and gather information. Nowadays, potentially unbounded and massive amounts of information are generated at high-speed rate, known as data streams. Therefore, it is unreasonable to assume that machine learning systems have su cient memory capacity to store the complete hist...
متن کامل